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ABSTBACT y 

In this study four research strategies used in 
previous studies of- the socialization of .cognitive skills were first 
contrasted and then assessed 4 in terns of five criteria, (The data 
base £or this study was*' 32 videotapes cf mothers preparing their 7- 
or 9-year-old dhildren to take a -memory test.) The four strategies 
(frequency coding, fine-g*ained sequential analysis, single-case _ 
ethnography, and comparative ethnography) are discussed in terms of * 
their utility for providing an empirically adequate account of how 
Individuals achieve meaningful 'communication' "within the context of an 

^evolming* interaction. Strategies are then evaluated in terms of (1) 
the questions each method can answer, (2) procedures related to data 
analysis, t3) problems of assessing the validity of *the analysis, (4) 
problems of assessing^ the reliability and validity of data 
collection, and (5) limits each strategy imposes on statements - 
concerning the generality of the findings, while all of* the 

, strategies were found to have utility* for examining/ particular 
aspects of data on the socialization of cognitive skills*, neither 
frequency coding nqr fine-grained sequential anai'ysis were found to 
represent adequately the complexity 5a f the dyadic interaction. -The 
single-case ethnographic. mettfod, however, was found to provide 

"accounts of how participants ^^ptly accomplished cognitive tasks, , 
how mothers established and maintained a common framework, and how 
both mother and child dftds.wqrked toward a transfer of 
responsibility for the direction, of the task. In order to examine the 
prevalence of structures of interaction found in <the single-case 
ethnographies, two, multi-case^ .comparative- ethnographic studies are 
presently being conducted. (Author/RH) . i 
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In this presentation we contrast four. research strategies .that we have - 



^ t used in studies of instruction and the development of cognitive skills/ 

0 s Our data base is*32 videotapes of mothers teaching their 7 or. nine year old 

CO • . r: 

O children. The mothers are preparing their children to, take a 'memorjf/test 

<\j . - r . -v 

Q on the organization of either groceries on ki tchen,shel ves (which we 'call* the 

LU . ' r ■ ; m , . 

home task) or photps of household items in compartments (which we call the 

. school task). ^» 1 • * * 

* We will first chronicle our research efforts through the four strategies > 

* listed on your handout; 

f * 1 ' "PERMISSION TO REPRODUCE THIS 

1. Frequency coding material has been granted by 

, 2.* Fine-grained sequential analysis /\C 

. . . , ' ^pyrt : 

3. - Single-case ethnography . • 

, < , * TO THE EDUCATIONAL RESOURCES 

S \ , • , " - , INFORMATION CENTER (HRIC)." ' 

4. Comparative ethnography ■ 
We will explain why w£ have explored each of these strategies in our research 
on the socialization of cognitive skills. We will then compare them on % 
■five criteria (alsVlisted* on % your .har\dout) ; 

/ We began our apalysis of the videotapes by devising a fixed co'ding scheme 



to determine the . frequencies of relevant actfons b£ the mothers and childrefl. 

We counted occurrences of verba> and nonverbal references to the membership. 

of items in groups, to, the requirements of ttie experimental ta'sk, and to 
* > 

the demands of the task on the chi Id 1 s^emcry k> among other things. For example, 
the stretch of transcript in your, handout was coded a^incfuding two gestures 
by the mother and one by the 'child',, two references to a category label 

" ' . ,• 2 • . 

* v. * .4* r ' . * J - S 



•/ 



' * 

* by the mother, etc. ilKIs coding gave. us'a; pi cture of *th£ methods of ■ ; 
instruction used by "the mothers, and the patterns of response to instruction 

4 * % S ' 

by the children. The variables were examined for the effects of the age 
cf the* chi 1 dren .and. compared for the home /vs. school tasks. 
„ . While the results of these studies were interesting, we were .frustrated 
» by their methodoTogy Reducing the data base to a few coded categories 

seemed* to require some arbitrary decisions concerning what constituted a 
' discrete, behavior. With .hindsight, we would say that discrete behaviors 

are ndt 'given 1 in reality and then^fourfd 1 by observers. Rather, they are 

\ . ' ' ' • 

cons tinted by observers from the "thick" information in the interaction. 

What troubled us then and now, however, was our belief that* the codirtg process 

removed the behavioral .event^ f rom /the contexts c^f;'the inter^tion necessary 

to' grasp their meaning. 

The interactional context contributes to the meaning of any act in a manner 

creation of a discrete behavioral event, 
lost with the/ t For ^xample, topographically identical behaviors may' 

- 1 * /' J 

be interpreted in several ways depending on the history ^pf the interaction. 

Thus the '[pother's qu^s^i'on "What do you think goes next?" may^iean one thing 

v 

if\a child has just solved a similar problem in the experimental task, but' 

N ^ # . ' j 

quite another if it* follows a success ioti of errors. Neither possibility has been 

captured; however, if it is -s imply* gi ven the label "open-ended questia/i". ^ 

JDuip Static* frequency code abstracted the behavioral events from the work 

the dyad was'doing on the 'problems of teaching and learning. . > \ 

This came home to us when we anl^ayzed the coded 4fta. We fcund that our 

interpretations of the meaning of statistical diff^rer/ces derived fcom our } * 

ch'/ect observation "of* the interactions, during the 'piloting ancl running 

j* » * * 

of thj* dyads, before we had reduced this information to the coded frequencies. 

It concerned us that wewere. retrieving the meaning" of our d^ta - 



unsystemati gaily, and only after carefully removing the data from the contexts 
4 /which permitted tf\eir, v interpretation. * / 
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i ; I ' , * 

* So w'e sought an alternative methodology that included some of. the 

*- ' • 

c6mplexity/ structure, and movement inherent/in interaction. Our fine-- m 
grained sequential analysis i'nvoltfed similar-behavior categories , but ' 
retained/ the time structure relating each act by the mo.ther and by the 'child. 

For example,- the transcript in the handout would be segmented into the 

child r s -turn, - 
sequence of mother's turn ',/jetc. with four turns by each in this' stretch 

# of transcript. Each secjfnent would then be coded, and the sequence 

of cpdes would be'analyzed: This allowed us to (Tompare interactions occurring 

early vs. late in the transcript, aod to, analyze the contingencies between, 

say, -the mother's behavior in^seKQnent and'the child's behavior in the next 

segment. * * 

We found fine-grained sequential studies to be extreifiely 

^ / 4 

time consuming; and we achieved relatively few interesting findings 

through them. Moreover, the*method could not in principleVolve the^problems 

we were concerned with. Although we turned to a sequential method to look at eve 

*« 

in the context of what v pre ce^?J5 # and fbllows them, we were still unable, to , 
handle the fa£t that at,$ny point in, an interaction the, participants are working 
in several dimensions oVbehaVior. > For Example, 'a mo.ther may be simul tah^ously 
maintaining her child's attention, eval ua ting 'the^ pace of instruction, mainfcainin 
her social status relative to the child, and working on a specific component' 
of the task 4 . Sequential analysis* like frequency counts, requires aifT observer 
to create a single t^nvioral event from the flow of the interaction at any 
point in time. The cod^d event i§ Vssigned the same raeanin'g wherever it 
occurs, across dyads and across ti me within dyads.. Such- analysis loses the 
participants' adaptations , to the Changing ci ncumstaoces -of ^the problem as they 
develop its .solution,. • » \ , , 
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]f nothing else, the experience with' fine-grained sequential analysis ' 

i y 
clarified what we wanted to Icnow. Whereas traditional psychological research* 

■ 2 ■ * > * 

attempts to relate discrete behaviors to discrete causes, we wanted to 

• % ♦ , 

investigate -how' individuals achieve meaningful cornmunicationwithin the * 
context of an evolving. interaction. What eyolves in an interaction is 
a jointly achieved framework of meaning in terms of whi^h the participants, 
ccpr.unicate. This is. obscured by dividing the cooperative actions of motherland 
hi Id into behaviors for which only one, 'is given credit.* • '* 

In our^ attempts to examine howyjinieractlonal framewprk is constructed, 
we were influenced particularly by the work. of 'Gicourel, M$han, CazdenJ 
artd 'McDermott, who argue that participants in social interaction signal 
the intended meanings o^their actions to each other. These signals '.are 
a,v % v.lable to the researcher and provide evidence for arguments concerning 

the meaning of r the interaction. McDermott, Gospodinoff , and Aron argue 

11 J f . - 

that we can use the way? members have of making clear to each other and 

to themselves -what is going on to locate to our own satisfaction an account 

Qf\bat it is that they are r doing with each other. Iq .fact, the v/ays they 

h&ve of making clear &g^each other what they are doing are identical to the' 

Criteria which we use to locate ethnographical ly what they are doing/' 

f- We first applied^these methods in what we will call -single- case 

. ethnography. Gardner and Rogoff carried out an 'intensi ve, interpretive 

/Analysis of one dyad's preparation for the memory test. Working from th£ 

^transcript oi* the interaction; we examined the, mother's direction of her 8t 



yi year-old child's memory activity. We argued that the mother and chid d jointly 
v accomplished the' child's cognitive performance on tfrisvtask. For example, 
jt by ta'lking > aloud her thoughts as she classified the items ,that the child . 
fl had to 'remember, the mother gave him a picture of how she would solved 
l i. the memory problem. $he worked to make these activities meaningful to the child 
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by anchoring* their meaning both in the context of a family k.itchen arid 
in the context of the task demands of the experiment. 'We argued that 
the mother's work to establish and maintain a epfrrr.on f ramework Vor the 

/ 

processing of information was essential for the cyad's joint accompl ishmeit 
of the task. v We concluded that Jointly wprking through cognitive tasks, 
cbiild be . important/ , in the socialization of children in cognitive 
skills, such as me.-pory strategies^** *.•'•' / 

Fo cusihg on another dyad, Rocfoff and Gardner found that both mother 
and child worked toward a transfer, of responsibility fo'r the direction 
of the task. The mother was observed subtly testing'her child's readiness 
by reducing 9r\e amount of direction and organization she provided for a component 
of the task. If the child made an error <Jr indicated a lack of readiness, „ 
'the mother quickly reerected^bhe 'scaffolding 1 she h?d momentarily^ ' 1 
removed.. These negotiations of responsibility were often transacted^ rough 
glances. and- other non-verbal cues, as in the* section of transcript from 
-this dyad given in the handout; A It appears from both this child's 
response to the mothers first question requesting identification of the 
item and from her reply to his attempt that she was searching for more 
than .the name of the item. He provides the name of the item, but not 

: * * r 

the appropriate qatecjory >1 able. She provides the category label, and waits 

^ , * \ . • ; y 

for h'im to place the item' In the appropriate box. * mien action r is not 
forthcoming from the. child, the mother makes his job more cortrete: finding . 
.another item 'in the safre'^ategory. S^e takes this a'step further and offers : 
higra candidate by ^djustirig an item v/hich would be an appropriate response 
to her latest; question. He takes the cue, indicates the item she has been m ■ 
adjusting, and, they 'finally get the item placed. Our pape,r consisted of 
sections of , transcript With discussions providing evidence for the interplay 
of testing and feedback described above. * % 
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Although we ane excited by what "toe have learned about the socialization 

of cognitive activity through our single-case ethnographies, we are how 

revising our approach again. When reading. ethnographies, we often "feel 

uneasy concerning how the author' selected the incidents illustrating 

his or'hel* points. In our own Work we want to find a way to assess the 

generality of cjur findings and to portray tfye variability of approaches tfsed 

by dyads. To achieve .this, we are now attempting some comparative or 

fnulti-ca&e ethnographies. The method of analysis Js similar,, but we " > ' 

t are now working with a larger data base to find common patterns appearing 

* «. • « 
.across individuals/ ■ * 

We are working on two multi-case projects: Gardner is replicating 

the Gardner and Rogoff analysis on six*dya.ds. Rogoff a^d Gauvaih 

a*e analyzing all 32 dya. ds in an analysis performed- in tyo stages. In 

the first stage, they summarize each dyad's progress in facing the items 

and preparing the child for the memory test. The transcript is x broken 

into episodes that-retain the sequerrce in which the actions occurred., 

» but using terms applicable 'across dyads to describe- th'&m. Far example, 

the episode represented ijv the sample transcript is. recorded as follows: < 

Eighth item placed, second one in compartment:. ' ' 4 J « 

Mother chooses item, child labels item and its function, 
Mother labels category and asks child^for as$ociated item* while { ' 
indicating a candidate, child indicates associated item. 
Mother and child each place item in box. % \ % ' * 

,Jr the second stage of analysis we group the episodes into phases^^/ 

- t -of instruction,, including ''Prelude" , "Orientation to ta$k M , "Item -placement \ * • . 

"readying for test 11 , and "Exit". In, eath phase, the approach" ea&h jtyad takes 

and how the responsibility for the components shifted -during the instruttion , 

is summarized.. We expect to be able to examine the prevalence of the structures 

found in the single-case ethnographies using these multi-<case ethno.graphi6approac 

• " To conclude we will compare the four methodologies' on five criteria* •* ^ 

<l. What .que stfons are the methods useful for answering? . ? 

eric • / • 4 7 . - 4 >. *' ^ 




2. How are the data analyzed? , . 

How can the validity of the analysis' be' assessed? 

4. How can the reliability a/id validity of the data collection 

* * « 

process be assessed? ' 

5. What statements can be made about the generality of the .findi ngs? 
We should caution that it is difficult to compare these methods, since, 
first, statistical methodology is much more highly developed tharr ethnography 
for psychological research. In fact, statistical methodology typically defines 
What we consider psychology to be. .Second, in both tracitional statistics 
and ethnography k it is difficult to sort 'out the real potential of the 
methods from the ideal claims that have been made for them. 

Frequency codes are rrost useful for questions concerning discrete behavioral 

events which .cair be assumed to follow some Vandom distribution. These kinds 

(^events occur naturally in many fields of study but, as we have argued, we 

are not sure that they are found in studies of ^social interaction. The . 

discrete interactional event, whose meaning is identical across time 

and dyads, is an abstraction created for the sake of statistical* analysis . 

This disadvantage, however, is compensated in part by what can be done with 

frequencies after they hav£ been tallied. A well defined statistical hypothesis 

can b(T evaluated in an impersonal and objective fashion, with a calculable 

V 

probability of error. Similarly, there is a well developed methodology for 

determining the reliability with whi£h the frequencies were tallied. 

K'e suggest, however, that the level of abstraction of the data is 'also 'a: hidden 

•m 

problem for reliability and analysis. Once the data base is coded in'tp freque^ncie 
it is effectively hidden j^rom everyone but the researchers. A researcher's inter- 
pretation of the theoretical meaning of statistical results always draws 
upon a deeper understanding of the data base than is captured*in his or her 
summary of the frequencies, ,The readervcould* have a better check on the 
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validity of the coding process if he'or she could, hav^access to'the raw • ■ 
material of the da'ta base. Frequency codes do, however, provide ready means for 
comparing individuals, within a study by using jtheir profile of scores. 
They also explicitly provide information on the prevalence within the 
sample of the pattern of findings reported, 

fine-grained sequential ana/yses inherit most of the advantages an^ 
disadvantages of frequency code's/' Sequential methods do allow researchers • 
to ask some questions 'using sequence of events as a variable: for example, * 
i£ a given behavior more ^pr^eva lent earlie^ or later iijTthe interaction? 
They can also be used to Examine contingencies between behaviors: are errors 
by the child more likely following questions or, directions by the mother? 
In practice, howler, we believe that these* are only modest advantages 
with respect ,to simple frequency codes. They are paid for'in a less well ^ 

vdeveloped statistical methodology and an exponential increase in the 
effort expended per study, * , > ^ • 

In single-case ethnography, one -ignores questions pf the prevalence 
of events across groups and seeks to extract the maximum of information # from 

-a single interaction. .Since only one case is being discussed, tftere is 
'no comparison Qf the effects of different conditions. Instead, the 
focus is shifted closer to the data base itself. The researcher seeks - 

\ 

a consistent interpretation of the meaning signalled by % the participants 
in the 'interaction, * The interpretation is supported by the presentation of 
transcripts of portions of the interaction r which provide data for the 
reader to judge whether the transcribed evidence 'really does support the 
investigators conclusions. .There are no .well developed methodologies for ^' 
assessing the reliability of the transcription, nor are the precision a'nd 
impersonality of statistical tests available.. Finally,, the rich data derived fro: 
single case do not allow statements about generality beyond the case examined. 
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Our ventures intQ multi-case ethnography sre attempts to 'remedy 
some of these problems. Our attention shifts from the richness of the 
single case to the communality of patterns within a group. We are working 
to, develop methods Whereby meaning can be discussed in terms that will 
allow us to assess* the generality of its patterns. It Will be necessary 
to develop 'rul es /or determining patterns and schematic ways of 
illustrating them. This will impose St greater .degree of abstraction on the 

data than i a single case. The sbstrs^fion ana larger deta base, ma U \1 

* > 
impossible to present more than a small portion of the database to the reader 

in any research publication. ^ 

Through our expl oration °of these four research strategies, we have gaihed sor 

appreciation of the advantages and tradeoffs 'of both/more traditional methods 

and the ethnographic approaches, -At present we feel that all the approaches 

we ha.ve discussed are useful, with each of them appropriate fc>r examining a 

different angle of data on- the socialization of cognitive skills, 
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*Four res'earch strategies: 
1 . Frequency coding 



2. 
3. 
4. 



Fine-grained sequential analysis 



Single-case ethnography' 
'Comparative ethnography 



J 



Sample of transcript from a mother and her 6-yearr'old son sorting photographs ' 
in the' "homework" task:- ' ' • . ' . , 



MOTHER 

: • x • > ■ u- ' 

- (picks up picture of bucket, hplds,it in 
irent of child) What's that? * ■ „ 



Yeah, and it helps -you clean, 
(looks at child) 

Okay, -what else, do 'you see v something 
else that helps you ftean? ; . 
(adjusts the broom in the ,' cleani ng 1 
box) f . • ' ' 



The broom, so it shauld be put in here 
(holds bucket in 'cleaning 1 box) 



CHILD 



it's- a bucket and it helps you 
carry thirrgs and.,, (fidgets) 



(child nods) 



(watches mother's hand on bucket, 
then points to bucket, then to broom) 



(takes bucket from mother's hand 
and places in correct box) ' 
Yeah. 



e criteria for, 



i 

<V, a lusting the*' research strategies: 



1. 

2. 

•J . 

4. 
5. 



What questions^Vre the methods useful for answering? \ 
How are the "dajtr-analyzed? 

Kow*tan the validity of the analysis be assessed? 

How can reliability and validity of the data collection be assessed? 

What statements can be made about the generality of the findings? 
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